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METHOD AND APPARATUS FOR LABELING AND ANALYZING 
CELLULAR COMPONENTS 
Related Application 

This application is based on a prior co-pending provisional application Serial 
5 No. 60/270,518, filed on February 21, 2001, the benefit of the filing date of which is 
hereby claimed under 35 U.S.C. § 1 19(e). 

Field of the Invention 
The present invention generally relates to a method and apparatus employed 
to probe and simultaneously analyze a plurality of cellular features, and more 
10 specifically, employs biomolecular probes labeled with different fluorescent markers 
in a multiplex color encoding scheme in which each probe produces a unique 
combination of colors. 

Background of the Invention 

The analysis of cells often involves the probing of various cellular components 
15 with fluorescent or absorbent substances to determine the presence, absence, 
abundance, and distribution of the target components within the cell. It is desirable to 
employ a large number of probes within a cell to facilitate studying the relationships 
between different cellular components. In some cases, the probes employed include an 
absorbent or fluorescent substance that exhibits a characteristic specificity for a cellular 
20 component, as in the case of certain DNA labels (e.g., ethidium bromide). However, 
most probes comprise a binding element combined with a signaling element. The 
binding element binds to a specific cellular component and is chemically linked to the 
signaling element, which produces a detectable signal - generally a fluorescent 
emission. Typically, fluorescence detection systems accommodate only a limited 
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number of fluorescent colors based on the available excitation wavelengths and the 
width of the spectral detection bands. The use of a separate signaling element gives a 
researcher control over the fluorescent color associated with each probe as a means of 
optimizing the results within the constraints of an illumination and detection system. 
5 Nevertheless, the total number of probes available to the researcher is typically on the 
order of the number of fluorescent colors that can be detected with a given apparatus. 
Hence, there exists a need to enable analysis of a large number of cellular probes with 
only a limited number of fluorescent colors. 

A wide variety of probes are available, enabling the analysis of cell type, 

10 viability, phase in the cell cycle, the level and activity of numerous biomolecules, as 
well as other types of information. For example, T-lymphocytes can be identified in 
whole blood by the binding of an FTTC-labeled monoclonal antibody to 
membrane-bound CD4 proteins. As another example, the viability of cells in a sample 
can be analyzed by exposing the cells to propidium iodide, which cannot penetrate live 

15 cells, but readily labels dead cells. In still another example, a cancerous sub-population 
of cells can be identified by labeling cellular deoxyribonucleic acid (DNA) with 4', 
6-diamidino-2-phenylindoIe (DAPI) fluorescent dye and producing a histogram of the 
DNA content of the population of cells. Deviations of the histogram from that of a 
normal cell population can indicate the presence of cancerous cells undergoing 

20 increased DNA replication and cell division. Depending on the analytical 
instrumentation employed, multiple probes can be combined within a cell and 
quantified independently. 

Flow cytometry is one technique that allows the use of multiple probes within 
cells for identifying cellular components. Flow cytometers are non-imaging devices 

25 that measure the intensities of multiple fluorescent probes simultaneously. The relative 
intensity of each of these fluorescent probes is indicative of various conditions within 
the cells in the sample population. From this information, conclusions may be drawn 
regarding the disease state of the cell or the reactivity of the cells to various drug 
candidates, etc. In general, it is desirable to employ as many different probes as 

30 possible in order to increase the amount of information obtained from the cells being 
analyzed. Typical flow cytometers are equipped with four photomultiplier tubes 
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(PMTs), each PMT being dedicated to detecting light of a different fluorescent color. 
Higher performance instruments may detect six or eight different colors. However, 
their lack of spatial resolution precludes conventional flow cytometers from 
determining the spatial origin of fluorescence signals within a cell. Indeed, the 
5 fluorescence emission of each color is integrated over the entire cell. Therefore, flow 
cytometry cannot be used for assays that require imaging, including numerous assays 
used in drug discovery. Further, the lack of spatial resolution effectively prevents the 
use of probes labeled with multiple colors, since probes that share colors cannot be 
distinguished from each other in flow cytometric measurements. Accordingly, the 

10 number of probes that can be measured in a flow cytometer is limited to the number of 
colors that can be detected. Hence, there is clearly a need to enable imaging of multiple 
fluorescent colors at high throughput for the purposes of implementing quantitative 
image-based assays and enabling the use of multiplexed color encoding of probes. 

In microscopy applications, cells are fixed to a slide and imaged onto a 

1 5 pixilated detector or scanned with a confocal laser arrangement. Three-color imagery is 
common for direct human observation, but most analytical microscopy platforms image 
one color at a time. Methods have been developed to serially image cells and cellular 
components in different colors, using the spatial resolution of microscopy to increase 
the number of probes that can be detected. 

20 One prior art use of microscopy for the detection of large numbers of probes 

is described in Prenatal Diagnosis 18:1181-1185 (1998) entitled "Poly-Fish: A 
Technique of Repeated Hybridizations That Improves Cytogenetic Analysis of Fetal 
Cells in Maternal Blood." The article discloses a method for multicolor fluorescence 
in situ hybridization (FISH) labeling of chromosomes and other cellular components 

25 in which the number of chromosomes may be directly counted to determine the 
incidence of trisomy, a task that requires both spatial resolution and multiple probes. 
In this process, three separate probes are simultaneously hybridized to three different 
chromosomes in interphase nuclei and then analyzed on a fluorescence microscope 
with a triple bandpass filter. The locations of interesting nuclei are noted, the first 

30 probes stripped from the slide, followed by re-hybridization using new probes linked 
to the same set of three colors to enumerate a different set of chromosomes. In all, 
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nine separate hybridization rounds are performed in which each hybridization 
involves up to three probes and three colors. As disclosed in the above-referenced 
article, Chromosomes X, Y, 1, 5, 6, 13, 18, and 21 were enumerated, with some 
chromosomes being probed multiple times. The article concludes that using this 
multi-step probing protocol, all 24 human chromosomes could potentially be 
analyzed using only three colors. However, the procedure is difficult to automate due 
to the complex probing protocol, the protocol is error prone due to incomplete 
denaturation of probes between hybridizations, and throughput is low due to serial 
hybridization steps and the need to produce multiple images of each cell. Many of 
these drawbacks could be addressed in a single-step process employing all of the 
required probes simultaneously. 

U.S. Patent No. 6,066,459 discloses a method by which all chromosomes are 
uniquely identified in a single-step probing protocol employing relatively few colors. 
Cells are cultured in the presence of a mitotic spindle poison, enriching the fraction of 
cells in metaphase. Locus-specific chromosomal probes, each labeled with a different 
fluorophore color, are then hybridized to specific locations on the various 
chromosomes. After hybridization, each chromosome exhibits a unique spectral 
banding pattern, analogous to a colored bar code. The method takes advantage of 
spatial separation of the probe colors along a chromosome, using a unique spatial 
sequence of probe colors on each chromosome to encode chromosomal identity. 

U.S. Patent No. 5,539,517 discloses a spectral imaging microscope that, when 
used in conjunction with the method of U.S. Patent No. 6,066,459, can produce a 
multi-spectral composite image of the chromosomes. The composite image is 
developed by sequentially imaging a field of view (FOV) using an interferometric 
technique in which each successive image detects a different set of wavelengths. In 
this manner, images taken at different points in time are used to construct a single 
composite image of the FOV covering a wide band of wavelengths, enabling the 
identification of each chromosome based on its characteristic color order. While this 
method is effective for highly-structured samples that produce repeatable probe 
sequences such as metaphase chromosomes, it cannot be generally applied to the high 
throughput multiplex probing of cells since it requires numerous time-consuming 
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sequential images of each FOV. Furthermore, the method requires the size of the 
probed biological matter to be large relative to the optical resolution of the imaging 
system in order to resolve the spectral banding pattern. These requirements are 
incompatible with many applications of biological analysis in which the probed 
5 matter is small relative to the spatial resolution of optical microscopy. 

These and other limitations of the prior art hinder the study of multiplexed 
cell-based assays in the drug discovery process, where cells are simultaneously 
exposed to multiple compounds and the behavior of multiple cellular components are 
analyzed. Likewise, limitations in the prior art prevent the use of high-throughput 
10 diagnostics, such as interphase chromosomal analysis, where more than three or four 

I s * 

O cellular components must be probed and analyzed simultaneously. 

S Another example of the state of the art of using singly labeled probes is 

fJ described in commonly owned U.S. Patent No. 6,249,341, entitled "Imaging and 

□ Analyzing Parameters of Small Moving Objects Such as Cells," filed on 

15 January 24, 2000, the drawings and disclosure of which are hereby specifically 
O incorporated herein by reference. This patent describes generating an image of FISH 

f=j probes, each of which includes a single binding element and a single signaling 

Jf; element. Each signaling element has an optical signature, such that each different 

pj labeled probe is uniquely discriminable by the optical signature of its signaling 

20 element. FIGURE 2A is illustrative of such an embodiment that images 
singly-colored probes. A single labeled probe bound to each of three features. Each 
single labeled probe includes a binding element and a single element. A first probe, 
made up of signaling element 410a and binding element 412a is associated with a 
feature 414a. A second probe is made up of signaling element 410b and binding 
25 element 412b and is associated with a feature 414a, while a third probe, made up of 
signaling element 410c and binding element 412c, is associated with a feature 414c. 
When an image 440 of the object is produced, the spectral signal of each signaling 
element is spatially separated based on the positions of the features on the object, as 
indicated by image portion 440a (due to signaling element 410a), image portion 440b 
30 (due to signaling element 410b), and image portion 440c (due to signaling 
element 410c). Each signaling agent is used to identify only a single feature. Thus 
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there is a one to one relationship between the number of signaling elements available 
and the number of features that can be probed. Notably, the '341 patent does not 
discuss the use of multiplexed probes within cells or other objects. Again, the total 
number of probes available to the researcher is typically on the order of the number of 
5 unique signaling elements that can be detected with a given apparatus. 

Accordingly, it will be apparent that an improved technique is required to 
overcome the limitations of the conventional approaches discussed above. It is 
expected that the new approach developed to address these problems in the prior art 
will also have application to the analysis of other types of cells and biological matter 

1 0 and may be implemented in different configurations to meet the specific requirements 
of disparate technological fields to which this method can be applied. It would be 
desirable to provide methods and apparatus that enable more features to be probed 
using fewer signaling elements, such that the total number of probes available to the 
researcher is greater than the number of unique signaling elements that can be 

1 5 detected with a given apparatus. 

Summary of the Invention 
The present invention is directed to a method and apparatus for the probing 
and subsequent simultaneous analysis of a multitude of features in cells, biological 
matter and other objects. In most embodiments of the analysis system, there is 

20 relative movement between an object and the imaging system, although it is 
contemplated that either (or both) may be stationary. However, in all cases the 
multispectral imagery necessary to discriminate probed features are acquired 
simultaneously. In addition, it should also be understood that while much of the 
following summary and the text that follows recite "an object," it is clearly 

25 contemplated that the present invention is preferably intended to be used with a 
plurality of objects and is particularly useful in connection with imaging a stream of 
objects such as cells. 

A key feature of the present invention is multiplexing multiple discriminable 
signaling elements per feature (or object) as a means of increasing the number of 

30 different probes that can be employed and discriminated in a cell. This enables the 
use of more probes within a cell than could otherwise be done with conventional 
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means, thereby enabling the collection of more information from the cell. Each 
labeled probe includes a probe element that selectively binds to a specific feature (or 
object), and at least one signaling element. The multiple discriminable signaling 
elements may be associated with a single binding element specific for the feature, or 
5 they may be associated with a set of binding elements, all of which are specific for the 
same or different components of the feature. 

One multiplexing method of the present invention is a binary color encoding 
scheme in which each feature is distinguished based on its unique color combination of 
signaling elements. Using C colors, the number of detectable color combinations and 
1 0 therefore the number of uniquely identifiable features P in the binary encoding scheme 
is: 

P = 2 c -l (1) 
Therefore, the use of four colors yields 15 unique color combinations for 
discriminating cellular elements. Similarly, using six colors will result in 
15 63 discriminable combinations. 

FIGURE 1 illustrates the possible color combinations of the binary encoding 
scheme in four colors, but the present invention is not limited to binary encoding. 
Also shown is this Figure is an alternative encoding scheme using unique color pairs, 
where the number of uniquely identifiable features P is given by: 

20 P = ^- (2) 

The present invention can also employ trinary or higher order encoding. 
Binary encoding effectively employs two intensities for each color; a color is either 
present or absent from a feature. More than two intensities can be employed to 
increase the number of possible color combinations. In this case the total number of 
25 detectable features P using C colors with / intensities is: 

P = I c -\ (3) 
As shown in Equation (3), four colors and four intensities results in 
255 uniquely distinguishable combinations. In the present invention, quantitative 



intensity measurement is useful even in a binary encoding scheme by enabling the 
discrimination of overlapping features that share a common color or colors within a 
cell. For example, if two red-containing features appear at the same location, the 
intensity of red will be increased relative to the other colors employed in one or the 
other of the features. 

A first embodiment of the present invention is directed to a set of labeled 
probes, each labeled probe including one binding element that selectively binds to a 
feature and multiple signaling elements. Each probe has an optical signature, such 
that each different labeled probe is uniquely discriminable by the composite optical 
signature produced by its signaling elements. The plurality of signaling elements 
provide a multiplexed signal, enabling more features to be probed using a smaller set 
of signaling elements. Note that as illustrated in FIGURE 2A, a one-to-one 
relationship exists between the number of features that can be probed, and the number 
of unique signaling elements available. In the present invention, the number of 
features that can be probed exceeds the number of unique signaling elements 
available. FIGURE 2B illustrates this encoding embodiment with binary coded 
probes, while FIGURE 2C illustrates this embodiment with intensity coded probes. 
Note that the multiple signaling elements on each probe can be identical to each 
other, or can be a combination of different signaling elements. 

In a second embodiment of the present invention, an optical signal is 
generated by a plurality of labeled probes bound to the feature, each labeled probe 
including the same binding element and at least one signaling element, each signaling 
element having an optical signature, such that each different feature is uniquely 
discriminable by the composite optical signature of its plurality of bound probes. 
Note that while singly labeled probes similar to those illustrated in FIGURE 2A are 
employed in this embodiment, the present method of using such probes is 
distinguishable. In this embodiment each different feature or object is capable of 
binding multiple singly-colored probes, each having an identical binding element, in 
sufficiently close physical proximity that the imaging system is unable to spatially 
resolve the different probes. As a result, the image of the feature or object contains a 
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multiplexed signal very similar to that which would be produced by a single 
multi-colored probe of the first embodiment described above. 

For example, a particular chromosome may contain repetitive tandem DNA 
sequences unique to that chromosome, each repetitive DNA sequence binding a 
single probe. Since the tandem repeats are immediately adjacent and cannot be 
resolved spatially, and each repeated sequence can randomly bind one of a plurality 
of singly-colored probes in the mixture, the imaging system detects multiple colors 
emitted from the chromosome at each pixel location in the image. FIGURE 2D 
illustrates this embodiment with binary coded probes. Intensity coding can be 
implemented in this embodiment by varying the proportion of the differently-colored 
probes. For example, if a mixture of signaling elements A, B and C are distributed 
equally (i.e. 33.3% A, 33.3% B, and 33.3% C) among a plurality of singly-colored 
probes binding to feature X, and signaling elements A, B and C are distributed 
unequally (50% A, 25% B, 25% C) among a plurality of labeled probes binding to 
feature Y, the multiplexed signal from feature X can be discriminated from the 
multiplexed signal from feature Y on the basis of the different relative intensities of 
the colors, even though the same colored signaling elements are employed in both 
cases. This concept is illustrated in FIGURE 2E. 

In a third embodiment of the present invention, an optical signal is generated by 
a plurality of labeled probes bound to the feature. The labeled probes employed in this 
embodiment are once again singly labeled probes, each labeled probe including a 
different binding element and at least one signaling element, each signaling element 
having an optical signature. Once again, such probes are employed in an 
unconventional fashion to generate a multiplexed signal. In the present embodiment, 
individual probes binding to a specific feature will include a plurality of different 
binding elements, rather than all probes having the same binding element. Each 
different feature becomes uniquely discriminable by the composite optical signature of 
its plurality of bound probes. For example, each of the different binding element may 
target a different domain or subunit of a given protein. Because individual protein 
molecules are below the resolution limit of the optical detection system, each protein 
will appear to emit a single multiplexed signal despite the fact that the signal arises 
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from multiple signaling elements, each of which may be physically attached to different 
binding elements at different locations on the protein. Binary coded and intensity 
coded probes of this embodiment are illustrated in FIGURES 2F and 2G, respectively. 

Preferably, each different signaling element is uniquely identifiable based on 
a wavelength of light associated with that signaling element. In some embodiments, 
each different signaling element is uniquely identifiable based on an intensity of a 
wavelength of light associated with that signaling element. 

In all embodiments of the present invention, multiplexed probes within a cell 
are discriminated by simultaneously acquiring a set of images of the object, each image 
being of a different spectral band and having sufficient spatial resolution to resolve the 
locations of features within the object. Corresponding locations are analyzed across the 
image set to determine the spectral composition, and therefore the probe identity, at 
each location in the object. FIGURE 3 illustrates the set of images projected onto the 
detector in one embodiment of the invention. This embodiment contains six discrete 
color zones on the detector, from violet on the left side, to red on the right side. In this 
example, the violet portion of the spectrum is used to image scattered laser light while 
the five color zones to the right are used for probe detection. 

In the present invention, the set of single-color images are acquired 
simultaneously, either on a single detector or on multiple detectors. Simultaneity is 
important for several reasons. First, the present invention is intended to be applicable to 
the imaging of living cells and other dynamic objects that can change internal structure 
over time. Without simultaneity across all single-color data, the position of probes may 
change between images, precluding correlation of probe position from one single-color 
image to the next. Secondly, probe spectra and intensities can change over time due to 
biological activity or exposure to light. As in the case of probes losing register between 
images, probes changing color or intensity can hinder discrimination. Finally, 
simultaneous probe imaging enables high throughput analysis. 

Another important aspect of the present invention is directed to a system for 
labeling and analyzing a plurality of different features associated with an object. 
Such a system includes a plurality of labeled probes, each different labeled probe 
having a uniquely identifiable image. Each labeled probe includes a binding element 
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selected from among a plurality of different binding elements included in the system, 
each different binding element selectively binding to a different feature, and at least 
one signaling element selected from among a plurality of different signaling elements 
included in the system. Each signaling element has a unique optical signature, such 
5 that at least two labeled probes that bind to different features include at least one 
common signaling element. Finally, the system includes means for imaging the 
object, the means identifying each different type of labeled probe bound to one of the 
plurality of different features associated with the object. 

In one embodiment, the means includes a collection lens disposed so that light 

10 traveling from the object passes through the collection lens and is focused along a 
collection path, and a dispersing element that receives the light from the collection 
lens and disperses the light into a plurality of light beams, as a function of a plurality 
of different discriminable characteristics of the light, the plurality of different 
discriminable characteristics being indicative of the plurality of different signaling 

15 elements. Such means also includes at least one pixilated detector, and an imaging 
lens that focuses each of the plurality of light beams on the at least one pixilated 
detector, producing a respective image corresponding to each of the plurality of light 
beams, the at least one pixilated detector providing an output signal for each 
respective image, each output signal indicating whether a different one of the plurality 

20 of signaling elements is associated with the object. Finally, such a system includes a 
signal processor coupled to receive the output signals from the at least one pixilated 
detector, the signal processor processing the output signals to determine which 
labeled probes are bound to features associated with the object. 

Preferably, the dispersing element includes one of a dichroic filters and a 

25 prism, and the at least one pixilated detector includes a time delay integration (TDI) 
detector. 

In another embodiment, the means includes at least one light source for 
illuminating the object, and a collection lens disposed so that light traveling from the 
object passes through the collection lens and travels along a collection path. Such 
30 means also employs a dispersing element that receives the light from the collection 
lens and disperses the light into a plurality of light beams, as a function of a plurality 
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of different discriminable characteristics of the light, the plurality of different 
discriminable characteristics being indicative of the plurality of different signaling 
elements, and at least one pixilated detector. An imaging lens is employed to focus 
each of the plurality of light beams on the at least one pixilated detector, producing a 
5 respective image corresponding to each of the plurality of light beams, the at least one 
pixilated detector providing an output signal for each respective image, each output 
signal indicating whether a different one of the plurality of signaling elements is 
associated with the object, and a signal processor is coupled to receive the output 
signals from the at least one pixilated detector, the signal processor processing the 
10 output signals to determine which labeled probes are bound to features associated 
with the object. 

In still another embodiment, the means includes a collection lens disposed so 
that light traveling from the object passes through the collection lens and travels along 
a collection path, and a plurality of light reflecting elements disposed in the collection 

15 path, each light reflecting element reflecting light of a different predefined 
characteristic, and passing light that does not have that predefined characteristic, the 
signaling elements in each object determining the characteristics of light traveling 
along the collection path, each light reflecting element being positioned at a different 
location with respect to the collection path to reflect light of a specific predefined 

20 characteristic in a direction different from that of other light reflecting elements, each 
light reflecting element being positioned along an axis of the collection path, such 
that passing light not reflected by a preceding light reflecting element reaches a last 
light reflecting element. Such means also includes at least one pixilated detector 
disposed to receive light that has been reflected by each of the light reflecting 

25 elements, the at least one pixilated detector comprising a plurality of pixilated 
regions, each pixilated region producing an output signal that is indicative of at least 
one characteristic of the signaling elements and thus indicative of labeled probes. 
Finally, a signal processor is coupled to receive the output signals from the plurality 
of regions, the signal processor processing the output signals to determine which 

30 labeled probes are associated with the object. 
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Other aspects of the invention are directed toward methods whose steps are 
generally consistent with the elements of the apparatus described above. 

Brief Description of the Drawing Figures 

The foregoing aspects and many of the attendant advantages of this invention 
will become more readily appreciated as the same becomes better understood by 
reference to the following detailed description, when taken in conjunction with the 
accompanying drawings, wherein: 

FIGURE 1 is a graphic illustration showing a plurality of multiplexed coding 
schemes that can be employed in the present invention to increase the number of 
components that are simultaneously probed; 

FIGURES 2A (Prior Art) is a graphic illustration showing how probes, each 
including only a single color and a single binding element, bind to different features 
of an object, producing a related set of images on a detector; 

FIGURES 2B-2G are a series of graphic illustrations showing different 
configurations of probes, each in accord with the present invention, bound to the 
same features of FIGURE 2 A, thereby producing a set of images on a detector; 

FIGURE 3 is a graphic illustration showing a set of images projected upon a 
detector in an embodiment of the present invention using six colors, including four 
colors for the probes; 

FIGURE 4 is an isometric view of an embodiment of an imaging system in 
which multiple legs are employed for prism-based spectral decomposition and 
imaging to collect light signals from multiple perspective positions; 

FIGURE 4A is a greatly enlarged section of a cuvette, a portion of which is 
broken away to show cells conveyed in a flow past the imaging system of FIGURE 4; 

FIGURE 5 is an isometric view of an embodiment of an imaging system for 
collecting multiplexed probe imagery from objects affixed to a solid substrate, in 
which spectral decomposition is accomplished with a filter stack, and in which a slit 
is used for spatial filtering of extraneous light; 

FIGURE 6 is an isometric view illustrating a plurality of different 
illumination modes of a prism-based embodiment of an imaging system for collecting 
multiplexed probe imagery from objects in flow; 
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FIGURE 7 is an alternative embodiment to that of FIGURE 6, in which a 
second set of imaging components and detector are included for monitoring light 
from an object, to collect three dimensional imagery; 

FIGURE 8 is a schematic diagram illustrating the optical convolution of a 
narrow FISH emission spectrum by the present invention, to image a non-multiplexed 
FISH probe in a cell; 

FIGURE 9A is a schematic diagram illustrating the optical convolution of 
two narrow FISH emission spectra by the present invention, to image a multiplexed 
FISH probe in a cell; 

FIGURE 9B is a schematic diagram like that in FIGURE 9A, but imaging a 
multiplexed FISH probe in which the two narrow emission spectra have substantially 
different intensities; 

FIGURE 10 is a schematic diagram illustrating how for a wider FISH 
emission spectrum, a digital deconvolution is provided by the present invention to 
resolve the image of a non-multiplexed FISH probe; 

FIGURE 11 is a schematic diagram illustrating how for a wider FISH 
emission spectrum, a digital deconvolution is provided by the present invention to 
resolve the images of a multiplexed FISH probe having two FISH emission spectra; 

FIGURE 12 is a functional schematic block diagram of the electronics system 
used to process the signal produced by a time delay and integration (TDI) detector in 
the present invention; 

FIGURE 13 is a schematic diagram illustrating how an imaging system in 
accord with the present invention is used with both multiplexed and non-multiplexed 
probes to determine whether a cell is from a male or female; 

FIGURE 14 is a plan view of an alternate embodiment that employs a spectral 
dispersion component comprising a plurality of stacked dichroic filters that spectrally 
separate the light incident on different portions of a detector; 

FIGURE 15 is an X-Y plot of several typical passbands for the dichroic filters 
employed in the embodiment shown in FIGURE 14; 
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FIGURE 16 is a schematic illustration of a detection filter assembly that may 
optionally be placed in front of the detector in the embodiment of FIGURE 18 to 
further suppress out-of-band light; 

FIGURES 17A-17E are X-Y plots of transmission vs. wavelength 
5 corresponding to different passbands of the filter segments of the detection filter 
assembly of FIGURE 16; 

FIGURE 18 is a plan view of another embodiment of the configuration of 
FIGURE 14, wherein the spectral dispersion filter system comprises a plurality of 
dichroic cube filters orientated at various angles to create the spectral dispersing 
10 effect; 

FIGURE 19 is a schematic isometric view of another embodiment of an 
imaging system for implementing the present invention, in which the spectral 
emission is not convolved with the image and in which the spectral decomposition 
occurs in an axis perpendicular to flow through the use of separate dichroic filters, 
1 5 imaging lenses, and detectors for each spectral region; 

FIGURE 20 is a schematic isometric view of yet another embodiment similar 
to that of FIGURE 19, but in which spectral decomposition occurs in an axis that is 
generally parallel to a direction of motion of a substrate carrying an object; and 

FIGURE 21 is a schematic plan view of a spectrally segmented detector for 
20 use in detecting and imaging light of several different spectral compositions. 

Description of the Preferred Embodiment 
It is anticipated that the present invention may be particularly applicable to 
the analysis of multiplexed probe signals from within cells, but it should be 
emphasized that this invention is applicable to the optical analysis of objects in 
25 general. Signaling elements binding to a feature of a cell or other object are 
multiplexed in the present invention to increase the number of combinations of 
uniquely discriminable probe entities. This enables a larger number of different 
features to be probed using fewer signaling elements than there are features. 
Although several embodiments exist to achieve the multiplexing function, in each 
30 embodiment, a given signaling element is usable for more than one purpose. For 
example, if a fluorophore is used as the signaling element, the same fluorophore can 
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be used to label several different probes and therefore may appear in multiple 
locations within the cell or other object. The identity of a component within the 
object will be determined by the combination of fluorophores present at a given 
location. Likewise, several embodiments of apparatus capable of reading the 
< plurality of uniquely discriminable probes on an object are disclosed for the present 
invention. However, in all such embodiments, the apparatus simultaneously acquires 
imagery of all signaling events. 
New Method for Probe Multiplexing 

The present invention analyzes the spectral content in every pixel of an image 
' by spectrally decomposing the image into multiple single-color images, one image 
per color. Any cellular component that is labeled with a unique color combination 
can therefore be discriminated. There are a number of methods of labeling a cellular 
component with multiple colors. 

A first probe labeling method, schematically illustrated in FIGURES 2B and 
Ul 15 2C, is to bind multiple fluorescent dye molecules (signaling elements) to a single 
O binding element, directly embodying the probe's multiplex color code on the probe 

itself. Various ratios of the different color fluorescent dyes can be bound to the 
M= binding element if intensity is included in the encoding scheme. When the binding 

m element of the labeled probe binds to its cellular target and the fluorescent molecules 

20 are excited, multiple fluorescent colors are emitted from each probe. As a result, this 
method can be employed to probe features within a cell that fall below the resolution 
limit of the imaging system, as long as the spectra from each pixel can be determined. 
In this method, an image pixel's spectral signature is independent of the number of 
labeled probes represented in that pixel. 
25 In referring to FIGURES 2A-2G, it should be noted that each Figure shows a 

plurality of features associated with an object, and one or more labeled probes bound 
to at least a portion of each feature. An image of the object is also shown for each 
Figure. For each Figure, for purposes of simplicity in these examples, the object has 
arbitrarily been defined as including three features of interest. The image in each 
30 Figure includes optically discriminable signatures provided by signaling elements 
included in labeled probes bound to each feature, but the individual signaling 
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elements themselves are not spatially discriminable in the images. The present 
invention optically images an object whose features have been marked. Each feature 
(and a multiplex or composite of the optical signatures of all the signaling elements 
bound to that feature) is evident in the image. While it is possible that some features 
are disposed so closely together for two features to "blur" together, often features of 
interest can be spatially distinguished in an image of the object. 

In the prior art, each individual signaling element was required to have a 
one-to-one relationship to either a specific feature, or a specific binding site on that 
feature. To be able to distinguish one feature from another, each signaling element 
had to be spatially resolved (i.e., spatially distinguished at distinct locations on the 
feature) from any other signaling element bound to the same feature. If two or more 
signaling elements bound to a feature could not be spatially resolved, the prior art did 
not enable the feature to be distinguished from other features that were marked using 



the same signaling elements for identification. 

o 

||l 15 In the present invention, it is not necessary to spatially resolve the signaling 

elements associated with the same feature, as long as each feature can be spatially 
Rj resolved from other features on the object. In the prior art, the location and identity of 

{7 each signaling element associated with a feature is used to identify the feature. In the 

present invention, the specific spatial location of each signaling element associated 
20 with a feature is irrelevant. Consider an image 442 of an object as illustrated in 
FIGURE 2B. The object includes three features, as indicated by features 414, 416, 
and 418. In image 442, each feature can be spatially distinguished from the other 
features, as is indicated by image portions 442a, 442b, and 442c. Thus, image 
portion 442a corresponds to feature 4 14, image portion 442b corresponds to 
25 feature 416, and image portion 442c corresponds to feature 418. As is clearly shown 
in FIGURE 2B, two signaling elements 410a are associated with feature 414. 
Referring to image 442, specifically image portion 442a, those two signaling 
elements are not spatially distinguishable. Both signal elements contribute to provide 
a multiplexed optical signature that is optically distinguishable, even though the 
30 separate signaling elements are not individually spatially discriminable. Note that the 
optical signature for feature 414 of FIGURE 2B is identified with the reference "2A," 



BIOLm38-l-J2«(X>38ap.di>c 



each signaling element 4 10a contributing an optical signature identified by the 
reference "1A." In FIGURE 2A, the optical signature of feature 414 of is identified 
as "1A," because in FIGURE 2A only a single signaling element 410a is associated 
with feature 414. When comparing image portions 440a and 442a (in FIGURES 2A 
and 2B), the optical signatures in each image can be distinguished based on the 
intensity of each optical signature ("1A" versus "2A"). However, the ability to 
optically distinguish optical signature 2A from optical signal 1 A is not a function of 
the ability to spatially discriminate the signaling elements responsible for the optical 
signatures. All that is required is that the composite optical signature from one 
feature be distinguishable from a composite optical signature of a different feature, 
where each optical signature is a function of the optical signaling elements associated 
with each feature. Details of the method and apparatus employed to produce such 
images are provided below. 

Referring once again to FIGURE 2B, a first probe associated with feature 414 
has two signaling elements 410a coupled to binding element 412a. A second probe 
having two signaling elements 410b coupled to binding element 412b is thus bound 
to feature 414. Note that feature 41 8 is uniquely identified without requiring the use 
of another signaling element. Feature 418 is identified by a third probe that includes 
one signaling element 410a and one signaling element 410b, each of which are 
coupled to binding element 412c. The composite optical signal identifying 
feature 418 is "1 A + IB." The order of the signaling elements relative to feature 418 
is irrelevant. As shown, signaling element 410a is disposed to the left of signaling 
element 410b. If their positions were reversed, the composite optical signature would 
be "1B + 1A." Referring now to image portion 442c, note that because image 
portion 442c does not spatially distinguish the relative positions of signaling 
elements 410a and 410b, it cannot be determined if the spatial order of composite 
optical signature is "1A+1B" or "IB + 1A." But in the present invention, 
feature 418 is positively identified by either 1 A + IB" or "IB + 1 A," whereas in prior 
art, a feature could not be positively identified unless the spatial position of "A" 
relative to "B" could be determined. The use of spatially independent optical 
signatures enables imaging systems to be employed that need not spatially resolve 
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each signaling element. One benefit of the imaging system used in the present 
invention is that it can operate very rapidly, enabling features to be identified much 
more quickly. By providing a multiplexed signal that does not need to be spatially 
resolved, it is contemplated that many new applications will be identified for this 
invention. 

In FIGURE 2C, the multiplexed signal employs intensity to distinguish 
between probes. The probe coupled to feature 414 has three signaling elements 410a 
and one signaling element 410b coupled to binding element 412a. The probe 
associated with feature 416 has two signaling elements 410a and two signaling 
elements 410b coupled to binding element 412b. Finally, feature 418 is identified 
with a probe having one signaling elements 410a and three signaling elements 410b 
coupled to binding element 4 12c. Referring to an image 444 of the object, note that 
both signaling elements 410a and 410b are each represented in the image portions 
corresponding to the different features. However, the different features are still 
distinguishable based on the unique optical signatures different combinations of the 
same signaling elements produced for each feature. An image portion 444a is 
produced by the three signaling elements 410a and the one signaling element 410b 
associated with feature 414. An image portion 444b is produced by the two signaling 
elements 410a and two signaling elements 410b associated with feature 416. Finally, 
an image portion 444c is produced by the one signaling element 410a and the three 
signaling elements 410b associated with feature 418. Note that the each image 
portion can be positively distinguished based on the intensities of the common 
signaling elements. Clearly, using intensity of a waveband in the multiplexed signal 
to distinguish between probes enables even more different features to be identified 
using a limited pool of signaling agents. 

A second probe labeling method is used to produce a mixture of probes that 
each include identical binding elements, each binding element being associated with a 
single fluorescent molecule. The different fluorescent molecules employed in the 
mixture of singly-labeled probes determine the feature's multiplex color code. A 
plurality of such probes bind to each feature of a cell or object, as illustrated in 
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FIGURE2D, which shows binary encoding (three features being identified using 
only two different signaling elements). 

In FIGURE 2D, features 424, 426 and 428 each include three binding sites, 
respectively labeled 424a-424c, 426a-426c, and 428a-428c. Thus, three probes are 
5 bound to each feature. The three probes bound to each feature of FIGURE 2D have 
the same binding element, and include a single signaling element. Because a plurality 
of individual probes are bound to each feature, a multiplexed signal is provided for 
each feature, even though each labeled probe includes only a signal signaling 
element. The three labeled probes bound to feature 424 each have one signaling 

10 element 410a coupled to binding element 412a, while the three labeled probes bound 
to feature 426 each have one signaling element 410b coupled to binding 
element 412a. Unlike the labeled probes associated with features 424 and 426, the 
labeled probes associated with feature 428 are not identical, even though each of 
these three labeled probes includes binding element 410c. The labeled probes bound 

15 to binding sites 428a and 428b of feature 428 each include signaling element 410a, 
while the labeled probe bound to binding site 428c of feature 428 includes signaling 
element 410b. 

In an image 446 of the object, again three distinct optical signatures are 
produced using only two signaling elements (signaling elements 410a and 410b). An 

20 image portion 446a is produced by the three signaling elements 410a that are coupled 
to feature 424 with three different labeled probes. It should be understood that image 
portion 446a would be the same regardless of whether the three signaling 
elements 410a associated with feature 424 were coupled to the feature with a single 
labeled probe (i.e. one labeled probe consisting of three signaling elements 410a and 

25 one binding element 4 12a) or the three different labeled probes shown in 
FIGURE 2D. An image portion 446b is produced by the three signaling 
elements 410b associated with feature 426. Finally, an image portion 446c is 
produced by the two signaling elements 410a and the one signaling element 410b 
associated with feature 428. Note that each image portion 446a, 446b, and 446c are 

30 very closely related to image portions 442a, 442b, and 442c of FIGURE 2B. It 
should be understood that even if image portion 446a (due to three signaling 



BIOUX>38-t-126»038ap.doc 



-21- 



elements 410a) and image portion 442a (due to two signaling elements 410a) were 
present in the same image, the different intensities of the signals would enable the 
different image portions (and hence the different features) to be distinguished, as long 
as the image portions do not overlap. Because features represent physical structures 
5 of an object, the image portions representing the signaling elements bound to the 
different features will generally be spatially separated on the resulting image. 

Various ratios of the different singly-labeled probes can be mixed to use 
intensity in the encoding scheme, as shown in FIGURE 2E. In FIGURE 2E, 
features 420, 422, and 423 each include four binding sites, respectively labeled 

10 420a-420d, 422a-422d, and 423a-423d. Thus, four probes are associated with each 
feature. The four probes associated with each feature of FIGURE 2E use the same 
binding element, and each includes only a single signaling element. As before, even 
though each probe includes only a single signaling element, because a plurality of 
individual probes are bound to each feature, a multiplexed signal is produce to 

15 identify each feature. The four labeled probes bound to feature 420 each have one 
signaling element coupled to binding element 412a; the four labeled probes bound to 
feature 422 each have one signaling element coupled to binding element 412b; and 
the four labeled probes bound to feature 423 each have one signaling element coupled 
to binding element 412c. In this embodiment, none of the features are identified 

20 using only a single type of signaling element, unlike the previous embodiments of 
FIGURES 2A-2D. The labeled probes bound to bindings site 420a, 420b, and 420c 
of feature 420 each include signaling element 410a, while the labeled probe bound to 
binding site 420d of feature 420 includes signaling element 410b. The labeled probes 
bound to bindings site 422a and 422b of feature 422 each include signaling 

25 element 410a, while the labeled probe bound to binding sites 422c and 422d of 
feature 422 each include signaling element 410b. The labeled probes bound to 
binding site 423a of feature 423 includes signaling element 410a, while the labeled 
probes bound to binding sites 423b, 423c, and 423d of feature 423 each include 
signaling element 410b. Even though the optical signatures of the labeled probes 

30 bound to each feature all include signaling elements 410a and 410b, the intensities of 
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the signaling elements in the optical signals associated with each feature are different, 
enabling each feature to be readily distinguished from the others. 

Referring to an image 448 of the object in FIGURE 2E, an image 
portion 448a is produced by the three signaling elements 410a and one signaling 
5 element 410b that are coupled to feature 420 with four different labeled probes. 
Again, image portion 448a would be the same regardless of whether the three 
signaling elements 410a and one signaling element 410b associated with feature 420 
were coupled to the feature with a single labeled probe (i.e. one labeled probe 
consisting of three signaling elements 410a, one signaling element 410b, and one 

10 binding element 412a) or the four different labeled probes shown in FIGURE 2E. 
This is clearly shown by comparing FIGURE 2C with FIGURE 2E. An image 
portion 448b is produced by the two signaling elements 410a and the two signaling 
elements 410b associated with feature 422. Finally, an image portion 448c is 
produced by the one signaling element 410a and the three signaling elements 4 10b 

1 5 associated with feature 423 . 

In such an embodiment, the resulting optical signature in a pixel included in 
an image of the object is theoretically dependent on the number of labeled probes 
represented at that pixel. If only a subset of the colors in the probe mixture bind to a 
region of the cell, the probe's multiplex color code will not be accurately represented 

20 in the optical signature at that pixel. However, it is generally true that even very 
small structures within the cell will bind to numerous labeled probes, and each pixel 
in the image of the object or cell will therefore integrate light from each of the labeled 
probes, making it very likely that each color in a probe mixture will be represented in 
the optical signature at a pixel of the image. An extension of this method does not 

25 require that the different binding elements of the labeled probes be identical, as long 
as they each bind to a cellular structure that is below the resolution limit of the optical 
analysis system. Under these conditions, the analysis system can still determine the 
color code of the probe on a pixel by pixel basis. 

A third labeling method relies not on determining the optical signature of a 

30 particular pixel, but instead on determining the optical signature of a cellular structure 
that spans several pixels. In this third method, several different probes specific to 
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different locations on the same cellular structure are employed. As in the second 
method, each cellular structure is labeled with a mixture of singly-labeled probes. 
Upon imaging, the cellular structure is segmented by its overall morphology and 
identified by the multiplex color code of its constituent probe labels. As is illustrated 
in FIGURES 2F and 2G, different binding elements are used to identify the same 
feature. 

In FIGURE 2F, features 425, 427, and 429 each include three binding sites, 
respectively labeled 425a-425c, 427a-427c, and 429a-429c. Thus, three probes are 
associated with each feature. Each of the three probes associated with each feature of 
FIGURE 2F have different binding elements, and include one of two different 
signaling elements. Specifically, the labeled probe bound to binding site 425a of 
feature 425 includes a signaling element 410a coupled to binding element 412a; the 
labeled probe bound to binding site 425b of feature 425 has signaling element 410a 
coupled to binding element 41 2b; and the labeled probe bound to binding site 425c of 
feature 425 has signaling element 410a coupled to binding element 412c. Similarly, 
the labeled probe bound to binding site 427a of feature 427 includes signaling 
element 410b coupled to binding element 41 2d; the labeled probe bound to binding 
site 427b has signaling element 410b coupled to binding element 412e; and the 
labeled probe bound to binding site 427c includes signaling element 410b coupled to 
binding element 4 12f. Referring to feature 429, the labeled probe bound to binding 
site 429a has signaling element 410a coupled to binding elements 412a; the labeled 
probe bound to binding site 429b has signaling element 410a coupled to binding 
element 412b; and the labeled probe bound to binding site 429 c includes signaling 
element 410b coupled to binding element 412d. Using only a limited set of signaling 
elements, features including a plurality of different binding sites can thereby be 
readily identified. 

In a related image 450 of the object, the three distinct optical signatures are 
still produced using only two signaling elements (signaling elements 410a and 410b). 
An image portion 450a is produced by the three signaling elements 410a that are 
coupled to feature 425 with three different labeled probes, each of which include a 
different binding element as noted above. An image portion 450b is produced by the 
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three signaling elements 410b associated with feature 427. Finally, an image 
portion 450c is produced by the two signaling elements 410a and the one signaling 
element 410b associated with feature 429. Note that the image portions 450a-450c of 
FIGURE 2F are identical to (that is they cannot be distinguished from) the image 
5 portions 446a-446c from FIGURE 2D. the set of labeled probes in FIGURE 2D are 
different from the set of labeled probes in FIGURE 2F only in their respective 
binding elements. The signaling elements are identical, as indicated by the respective 
image portions. 

In FIGURE 2G, features 430, 432, and 434 each include four binding sites, 

10 respectively labeled 430a-430d, 432a-432d, and 434a-434d, and four probes 
associated with each feature. None of the four probes associated with each feature of 
FIGURE 2F includes the same binding element, and no feature is identified using 
only a single signaling element in all of the probes bound to that feature. Despite the 
plurality of different binding elements required in this embodiment, only two 

15 different signaling elements are required to uniquely identify all three features. While 
more features would require more signaling elements, clearly the required one-to-one 
correspondence between each feature and each different signaling element of the 
prior art (FIGURE 2A) is avoided. 

The four labeled probes bound to feature 430 are configured as follows. The 

20 labeled probe bound to binding site 430a has signaling element 410a coupled to 
binding element 412a; the labeled probe bound to binding site 430b includes 
signaling element 410a coupled to binding element 412b; the labeled probe bound to 
binding site 430c has signaling element 410a coupled to binding element 412c; and 
the labeled probe bound to binding site 430d includes signaling element 410b coupled 

25 to binding element 41 2d. The four labeled probes bound to feature 432 are 
configured as follows. The labeled probe bound to binding site 432a includes 
signaling element 410a coupled to binding element 412a; the labeled probe bound to 
binding site 432b has signaling element 410a coupled to binding element 412b; the 
labeled probe bound to binding site 432c includes signaling element 410b coupled to 

30 binding element 41 2d; and the labeled probe bound to binding site 432d has signaling 
element 410b coupled to binding element 412e. Finally, in regard to feature 434, the 
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labeled probe bound to binding site 434a includes signaling element 410a coupled to 
binding element 412a; the labeled probe bound to binding site 434b has signaling 
element 410b coupled to binding element 412d; the labeled probe bound to binding 
site 434c includes signaling element 410b coupled to binding element 412e; and the 
labeled probe bound to binding site 434d includes signaling element 410b coupled to 
binding element 412f. 

Referring to an image 452 of the object shown in FIGURE 2F, an image 
portion 452a is produced by the three signaling elements 410a and one signaling 
element 410b that are coupled to feature 430 with four different labeled probes, each 
of which includes a different binding element. An image portion 452b is produced by 
the two signaling elements 410a and the two signaling elements 410b that are coupled 
to feature 432 with four different labeled probes, each of which includes a different 
binding element. Finally, an image portion 452c is produced by the one signaling 
element 410a and the three signaling elements 410b associated with feature 434. 
Note that the image portions 452a-452c of FIGURE 2G are identical (that is they 
cannot be distinguished from) to the image portions 448a-448c from FIGURE 2E. 
The set of labeled probes in FIGURE 2G are different from the set of labeled probes 
in FIGURE 2E only in their respective binding elements. The signaling elements are 
identical, as indicated by the respective image portions. 

A common feature in all of the embodiments discussed in reference to 
FIGURES 2B-2G is that at least one labeled probe binding to a feature of an object 
includes a signaling element that is also included in a labeled probe binding to a 
different feature of the object. Also, the ability of the imaging systems disclosed 
herein to discriminate spectrally and by intensity, the simultaneous multiplexed 
contributions of a plurality of probes, enables the probes to be readily detected, so that 
the features to which they are bound can be efficiently identified. 
New Method for Analyzing Probe Multiplexes 

A new flow imaging system and method for analyzing probe multiplexes 
overcomes the problems experienced in the prior art for carrying out this task and 
adds new capabilities to the analysis and handling of cells that are provided with 
probes. The flow imaging system enables the discrimination of the different 
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multiplexed probes within a cell and therefore enables the analysis of many biological 
parameters at a time. By handling cells in suspension and using hydrodynamic 
focussing, billion-count cell samples can easily be moved through the FOV of the 
flow imaging system at high rates. Existing non-imaging flow cytometers cannot be 
used with this multiplex scheme because within a given cell, different probes having 
any colors in common cannot be distinguished from each other without spatial 
information. Existing imaging systems cannot be used with this multiplex scheme, 
because the scheme requires multiple images, each of a different color, to be acquired 
simultaneously. 

The present invention for analyzing cells in flow includes subsystems that 
carryout the tasks of: optical signal collection and spectral decomposition, pixilated 
detection, illumination, cell velocity detection, and sample handling. It will be 
apparent to those of ordinary skill in the art that, depending upon the probing and 
image acquisition methods applied in the present invention, one or more of these 
systems may not be required. 

An important aspect of the present invention lies in the ability to 
simultaneously discriminate the location of the various fluorescent emission spectra 
produced by probes in or on a cell. This ability enables the rapid determination of the 
type and location of each probe after a cell has passed through the FOV. 
Hydrodynamic focusing ensures that the cells are at or near the focal plane of the 
imaging system and are lined up in a single file along the axis of flow. The imaging 
system can be constructed to view the cells from multiple angles to produce image 
data of a greater fraction of the cell's surface and volume, to enable the construction 
of a three-dimensional representation of the cell. The present invention takes 
advantage of the single file orientation of the cells in order to spectrally decompose 
the signal from each cell in the axis perpendicular to flow and then forms images of 
the probes within a cell onto a single or multiple detectors. The location of the 
images on the detector is determined by the spectral content of the signal emitted 
from a probe as well as the spatial position of the probe with respect to the cell. 
There are four embodiments of the present invention that accomplish the spectral 
decomposition and imaging of the probes in this manner. 
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First Embodiment for Spectral Decomposition and Imaging 

A first embodiment of the present invention is shown in FIGURE 6, which is 
also included in U.S. patent application Serial No. 09/490,478, entitled, "Imaging and 
Analyzing Parameters of Small Moving Objects Such as Cells," filed on 
January 24, 2000, the drawings and disclosure of which are hereby specifically 
incorporated herein by reference. In this previously filed application, there is no 
discussion of identifying multiplexed reporters within cells or other objects. 
However, the following describes how the apparatus disclosed in this previously filed 
application can be employed for spectral decomposition and imaging of objects that 
include a plurality of multiplexed reporters. In regard to the present invention, a cell 
provided with multiplexed probes is simply a specific type of object. Note that where 
there is any variance between the description in any document incorporated herein by 
reference and the present disclosure, the present disclosure takes precedence. 

As shown in the FIGURE 6, a column of cells 22 is hydrodynamically 
focused to a well-defined region; light from the cells is collimated by passing through 
a collection lens 32. There is relative movement between the cells and the imaging 
system illustrated in the Figure. As illustrated in this example, the cells are moving in 
the column, past the imaging system. The light from the cells travels along a 
collection path 30. A spectral dispersing element 36 disposed in the collection path 
spectrally disperses the collimated light that has passed through the collection lens in 
a plane that is substantially orthogonal to a direction of relative movement between 
the cells and the imaging system, producing spectrally dispersed light. An imaging 
lens 40 is disposed to receive the spectrally dispersed light, producing an image from 
the spectrally dispersed light. Also included is a pixilated detector 44, disposed to 
receive the image produced by the imaging lens. Details of one exemplary pixilated 
detector are schematically illustrated in FIGURE 21. As the movement of the cells 
relative to the imaging system occurs, the image of the object produced by the 
imaging lens moves from row to row across the pixilated detector. As will be 
described later, the pixilated detector may be a TDI-type detector or a frame type 
detector. 
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As a result of light collimation by the collection lens in this embodiment of 
the imaging system, all light emitted from a first point in the cell travels in 
substantially parallel rays. Light emitted from a second point in the cell will also 
travel in substantially parallel rays, but at a different angle relative to light from the 
5 first point. In this manner, spatial information in the cell is transformed by the 
collection lens into angular information in the collection path. The spectral dispersing 
element acts on the collimated light in the collection path, such that different spectral 
components of the collimated light leave the spectral dispersing element at different 
angles, in a plane substantially orthogonal to the direction of relative movement 

10 between each cell and the imaging system. In this manner, both spatial and spectral 
information in a cell are transformed into angular information. The imaging lens acts 
on the light from the dispersing element to transform different light angles into 
different positions on the detector. Spatial information is preserved by the system, 
since light from the different positions in the cell is projected to different positions on 

15 the pixilated detector, in both axes. In addition, light of different spectral composition 
that originates from the cell is projected to different positions on the detector in an 
axis substantially orthogonal to the movement. In this manner, the spatial 
information from the cell is preserved, while simultaneously collecting spectral 
information covering a large bandwidth at high resolution. 

20 When used for multiplexed probe identification in accord with the present 

invention, this apparatus provides substantial utility in resolving probe location and 
spectra on the detector, even when the probes are disposed in spatially close 
relationship within a cell. When spectral imaging occurs in the present invention, the 
spatial distribution of light in the cell is convolved with the spectral distribution of 

25 that light to produce the image of the cell at the detector. This convolution can result 
in blurring in the dispersion axis, depending on the spectral bandwidth of the light. 
Narrow spectral bandwidths will result in little or no blurring depending on the 
spectral resolution of the system. In the present invention, it is contemplated that the 
spectral resolution will be approximately 3 nm per pixel, with a spatial resolution in 

30 object space of approximately 1 micron. However, the spatial and spectral resolution 
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can be adjusted to match the requirements of the particular application, and the 
exemplary specifications set forth above should not be considered limiting. 

FIGURE 8 illustrates an image on a detector produced by an embodiment of 
the present invention with a spectral resolution of approximately 10 nm per pixel and 
a spatial resolution of approximately 0.5 microns. In the following discussion of 
FIGURES 8 through 10, the operation of the present invention is directed toward the 
identification of multiplexed and non-multiplexed FISH probes bound to specific 
DNA with cells. FIGURE 8 illustrates how the present invention is used to image a 
cell 140 having a nucleus 142 in which is disposed one non-multiplexed FISH 
probe 144 having an emission spectrum 146. Emission spectrum 146 of FISH 
probe 144 is approximately 10 nm in width and would be produced, for example, by 
"quantum dots" or a narrow-band fluorescent dye. The optical convolution of the 
narrow bandwidth spectrum results in minimal blurring of a FISH spot 148, enabling 
it to be readily resolved on detector 44. 

In FIGURE 9 A, a cell 150 is illustrated having a nucleus 152 in which is 
disposed a FISH probe 154 having two emission spectra. Each of the emission 
spectra of FISH probe 154 is relatively narrow, for example, corresponding to the 
emission spectra from quantum dots, as indicated by wavebands 158 and 160, and 
therefore, just as in FIGURE 8, minimal blurring occurs in FISH spots 162 and 164 
on detector 44. Furthermore, the spectral dispersion of the present invention, which 
maps wavelength into a lateral position on detector 44, produces a relatively wide 
physical displacement of FISH spots 162 and 164, despite the single source location 
of FISH probe 154 in the cell. 

FIGURE 9B illustrates the FISH emission spectra of FISH probe 154 when 
intensity is used to distinguish between different probes. As shown therein, a FISH 
emission spectrum 160' is approximately one half the intensity of FISH emission 
spectrum 158. Corresponding FISH spots 162 and 164' on TDI detector 44 will thus 
have two substantially different intensities, as well as being spectrally distinguishable. 
Accordingly, the relative intensities of the FISH spots produced on the detector can 
provide further information useful for identifying a FISH probe on an object being 
imaged. 
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Taken together, FIGURES 8, 9A, and 9B illustrate how the present invention 
discriminates multiplexed and non-multiplexed FISH probes, thereby enabling the 
enumeration of numerous genetic traits. FIGURE 13 illustrates how male and female 
cells 200 and 208, respectively, and FISH spots contained therein are imaged upon a 
pixilated detector in the present invention. Light of shorter wavelength, such as that 
producing a green laser scattered image 212, will be focussed on the left side of TDI 
detector 44. Light of slightly longer wavelength, such as a yellow nuclear 
fluorescence 214 from cell nuclei 202 or 210, will be laterally offset to the right. 
Light of still longer wavelengths, such as an orange FISH signal fluorescence 216 
from an X-chromosome FISH probe 204 and a red FISH signal fluorescence 218 
from a Y-chromosome FISH probe 206, will be focussed progressively farther to the 
right on the detector. In this manner, different components of a cell that fluoresce at 
different wavelengths will be focussed at different locations on the detector, while 
preserving the spatial information of those components. Each component image may 
be broadened laterally due to the width of its associated fluorescence emission 
spectrum. However, this broadening can be corrected based upon a priori knowledge 
of the emission spectra. Deconvolution of the emission spectrum from the broadened 
component image will yield an undistorted component image. Further, since the 
spectral dispersion characteristics of the spectral dispersing element are known, the 
lateral offsets of the different color component images can be corrected to reconstruct 
an accurate image of the cell. 

FIGURES 10 and 1 1 illustrate that the present invention can also be used with 
light of wider spectral bandwidth if an additional signal processing step is performed 
to correct for lateral blurring due to the wide emission spectra. In FIGURE 10, a 
cell 140 having a nucleus 142 with a FISH probe 170 disposed in the nucleus is 
shown. FISH probe 170 is characterized by producing a relatively wide emission 
spectrum 172. When optically convolved by the spectral dispersion provided by the 
present invention, a FISH spot 174 is produced on detector 44, but the image is 
laterally blurred across the detector, as a result of the relatively wide emission 
spectrum. To more clearly resolve the separation of the FISH spot from probe 174, a 
deconvolution of the signal produced by detector 44 with the known FISH emission 
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spectrum is carried out, producing an accurate FISH spot representation 178 on a 
display 176. The decon volution step enhances the ability to enumerate multiple FISH 
spots within the cell in accord with the present invention. 

In FIGURE 11, a FISH probe 180 in a nucleus 152 of a cell 150 emits two 
5 relatively wide emission spectra 184 and 186. These relatively wide spectra produce 
corresponding laterally blurred FISH spots 188 and 190 on detector 44. Applying the 
decon volution step, as noted above, produces accurate FISH spot representations 192 
and 194 of the two spectra on display 176, as shown in the Figure. 

A system 230 for analyzing the signal produced by detector 44 and for 

10 performing the decon volution steps described above is illustrated in FIGURE 12. In 
FIGURE 12, the signal from detector 44 is applied to an amplifier 232, which buffers 
the signal and amplifies it to achieve a level required by an analog-to-digital (A-D) 
converter 234. This A-D converter converts the analog signal from amplifier 232 into 
a digital signal that is input into a line buffer 236. Line buffer 236 temporarily stores 

15 the digital signal until it can be processed by a central processing unit (CPU) 238. To 
carry out the deconvolution noted above, a spectral buffer 240 is loaded with the 
known emission spectrum for each of the FISH probes being used so that their 
emission spectra can be deconvolved with the signal stored in line buffer 236. 
CPU 238 is a high speed processor programmed to carry out the deconvolution and 

20 other analysis procedures, enabling the identification of desired characteristics or 
parameters of the object being imaged. The output from CPU 238 is temporarily 
stored in an image line buffer 242 that enables the image to be displayed or otherwise 
recorded for later analysis. 

Those skilled in the art will appreciate that the present invention is intended 

25 for the discrimination of multiplexed probes. FIGURE 3 illustrates the results of 
processing the imagery on the detector in a multiplexed probe scenario, in which the 
emission spectra from each probe have been deconvolved. In this Figure, an 
image 300' of a cell 300 having a nucleus 302 that contains non-multiplexed 
probes 304, 306, 308, and 310 so that each probe generates an image 310', 308', 304' 

30 and 306', respectively, in only one color zone (blue, green, yellow, and red) on the 
detector. (Note that the relative positions of the other probes not imaged are shown as 
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dotted line, unfilled circles in each of the other color zones.) An image 302' of the 
nucleus appears in an indigo color zone. 

A cell 316 having a nucleus 318 contains probes 320, 322, 324, and 326, 
which are multiplexed using four colors in the lower portion of FIGURE 3. An 
5 image 318' of the nucleus is included in the indigo color zone. Each of the 
multiplexed probes generates imagery in more than one color zone on the detector. 
Thus, in the blue color zone, images 320b and 326b are formed for probes 320 and 
326, respectively; in the green color zone, images 320g and 322g are formed for 
probes 320 and 322; in the yellow color zone, images 320y and 324y are formed for 

10 probes 320 and 324; and in the red color zone, images 320r, 322r, and 326r are 
formed for probes 320, 322, and 326, respectively. (The relative locations of the 
other probes not imaged in each color zone are again indicated by dotted line, unfilled 
circles.) FIGURE 3, which is discussed in greater detail below, also illustrates the use 
of the non-convolving spectral decomposition and imaging system discussed in the 

15 next section. 

Spectral Decomposition and Imaging 

In one embodiment of the present invention, a spectral dispersing component 
having characteristics that ensure no distortion or convolution of the image occurs 
due to the emission bandwidth is employed, and as a result, a deconvolution is not 

20 needed to correct the image. A detailed disclosure of the spectral decomposition and 
imaging system is included in U.S. Patent No. 6,21 1,955, entitled "Imaging and 
Analyzing Parameters of Small Moving Objects Such as Cells," filed on 
March 29, 2000, the disclosure and drawings of which are hereby specifically 
incorporated herein by reference. 

25 One preferred spectral dispersing component 250, which is illustrated in 

FIGURE 14, comprises a plurality of dichroic beam splitters, such as dichroic 
mirrors, which are arranged to reflect light within different predefined bandwidths at 
different predefined angles. Unlike a prism, where light of different wavelengths 
leave the prism at different angles, all light within a predefined bandwidth incident on 

30 a dichroic beam splitter 252 at a common angle is reflected by the dichroic beam 
splitter at the same angle. Consequently, there is no convolution between the 
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emission spectrum of the light leaving the object and the image of that object. When 
using such a spectral dispersing component, light of a first spectral bandwidth is 
reflected from the first dichroic beam splitter toward detector 44 at a predefined 
nominal angle. Light of a second spectral bandwidth passes through the first dichroic 
beam splitter to the next dichroic beam splitter and is reflected therefrom toward 
detector 44 at a different predefined nominal angle. Light of a third spectral 
bandwidth passes through the first and second dichroic beam splitters to a third 
dichroic beam splitter and is reflected therefrom at a third predefined nominal angle. 
Each angle of reflection is relative to an axis 257. The dichroic beam splitters are 
selected to cover the desired light spectrum with the appropriate spectral passbands. 
FIGURE 15 illustrates the transmission characteristics of the dichroic filters used in 
the embodiment of FIGURE 14. The angle of each dichroic beam splitter is set such 
that light reflected from it within the corresponding spectral bandwidth for the 
dichroic beam splitter is focussed onto a different region of the detector. Since the 
present invention uses a narrow field angle in object space along axis 257, 
perpendicular to the axis of motion, many different spectral bandwidths can be 
simultaneously imaged onto a single detector. In this manner, each region on the 
detector may cover a different spectral bandwidth, while light is collected over the 
same field angle in object space. 

Depending on the amount of out-of-band rejection required, a bandpass 
filter 254 is optionally placed in front of detector 44. FIGURE 16 illustrates the 
construction of a bandpass filter that may be placed immediately adjacent to the 
detector in the present invention. As shown in FIGURE 16, the bandpass filter 
comprises a plurality of narrow spectral filters 256, 258, 260, 262, and 264 that are 
placed side-by-side to cover regions of the detector in correspondence with the 
spectral information to be imaged in those regions. FIGURES 17A-17E illustrate the 
spectral bandpass characteristics for each zone of the bandpass filter shown in 
FIGURE 16. Since the position of each spectral bandwidth region is predefined, and 
since the present invention maintains the spatial integrity of the object, a full color, 
high spectral resolution representation of the object is generated from the spectral 
information imaged onto the detector. 
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FIGURE 18 illustrates another embodiment of the spectral dispersion 
component in which light does not pass through another dichroic filter after reflection 
from a dichroic filter component. In this embodiment, a plurality of cube dichroic 
filters, including a red cube filter 266, a yellow cube filter 268, a green cube 
filter 270, and a blue cube filter 272 are spaced apart sufficiently to ensure that light 
does not pass through any of the cube filters more than once. As with the 
embodiment shown in FIGURE 14, the cube dichroic filters are oriented at 
appropriate angles to image light within a predefined bandwidth to distinct regions on 
a detector 274. As the light is reflected from each of cube dichroic filters 266, 268, 
270 and 272, it is directed toward imaging lenses 40a and 40b, and different bandpass 
portions of the light are focussed upon corresponding red, yellow, green, and blue 
light receiving segments or regions defined on a light receiving surface of 
detector 274. If desired, an optional detector filter assembly 276 of similar 
construction to bandpass filter 254 (but without the orange spectral region) may be 
used to increase the rejection of out-of-band signals. It should be apparent to those of 
ordinary skill in the art that separate spaced-apart plate, or pellical beam splitters 
could alternatively be used in this application instead of the cube filters. In the 
embodiment illustrated in FIGURE 18, imaging lenses 40a and 40b must be placed a 
sufficient distance away from the plurality of cube filters to minimize the clear 
aperture requirement for lenses 40a and 40b. Those skilled in the art will appreciate 
that the clear aperture in the plane orthogonal to the page can increase as the distance 
between the lenses and plurality cube filters increases. Therefore, the placement of 
lenses 40a and 40b must be chosen to appropriately accommodate the clear aperture 
in both planes. 

The foregoing descriptions of these preferred embodiments of spectral 
dispersion components illustrate the use of four and five color systems. Those skilled 
in the art will appreciate that a spectral dispersing component with more or fewer 
filters may be used in these configurations in order to construct a system covering a 
wider or a narrower spectral region, or to provide different passbands within a given 
spectral region. Likewise, those skilled in the art will appreciate that the spectral 
resolution of the present invention may be increased or decreased by appropriately 
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choosing the number and spectral characteristics of the dichroic and/or bandpass 
filters that are used. Furthermore, the angles or orientation of the filters may be 
adjusted to direct light of a given bandwidth onto any desired point on the detector. 
The use of these preferred embodiments for imaging light from an object are not 
5 limited to objects in flow, but may also be applied to imaging objects on substrates as 
long as the FOV is sufficiently narrow in the axis substantially orthogonal to the 
plane of spectral decomposition to prevent crosstalk between the decomposed 
images. 

FIGURE 3 illustrates the images projected onto a detector for the present 
10 spectral decomposition embodiment in the case where two cells are in view. In this 
illustration, each cell 300 and 316 has a series of four unique multiplexed probes 
visible, in which the probes are constructed of up to four distinct fluorochromes. 
There is no spreading of the probe images on the detector, as occurs in the 
prism-based spectral decomposition embodiment. Cell 300 utilizes one type of 
15 signaling element per probe, while cell 316 uses a multiplexed combination of up to 
four signaling elements per probe. 

Another Embodiment for Spectral Decomposition and Imaging 

An embodiment 350 of an imaging system, which is illustrated in 
FIGURE 19, is similar to the embodiments described above in that no convolution of 

20 the emission spectra with the image occurs as a result of the spectral decomposition 
process. One or more illumination sources 370 are optionally used to illuminate the 
objects. Spectral decomposition occurs in an axis 352 that is perpendicular to a 
flow 354 through the use of dichroic filters 356, 358, 360, 362, and 364, generally as 
previously described above. However, in this embodiment, separate imaging 

25 lenses 366a, 366b, 366c, 366d, and 366e and separate pixilated detectors 368a, 368b, 
368c, 368d, and 368e are used for each spectral region. In this configuration, each 
detector may have a very narrow aspect ratio, and very few pixels are required in the 
axis perpendicular to flow, since the field angle in that axis is approximately 25 arc 
minutes. In the case where a six-color version of this embodiment is employed, the 

30 images on a single detector would appear like the images seen on one zone of the 
detector illustrated in FIGURE 3. For example, the images seen on the detector 
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configured to receive light in the red part of the spectrum would appear like the 
right-most zone or red color zone of FIGURE 3. Since the total number of pixels in 
each pixilated detector is low, these detectors may operate at very high speeds. 

As disclosed in the above- referenced U.S. Patent No. 6,249,341 and as shown 
5 in FIGURES 4 and 4A, and in FIGURE 7, multiple legs of the spectral 
decomposition and imaging system may be used to collect signals from multiple 
perspectives as cell (or other objects) 24 flow through a cuvette 23 having a square 
cross section. Two legs are shown in FIGURE 4, one having a detector 44a and the 
other a detector 44b. However, if epi illumination is applied, as shown in 
10 FIGURES 6 and 7, four legs may be used to view the cells from each side of the 
M= cuvette. Light emitted from the objects may also be collected with objective lenses 

Q 

p that can be optically coupled directly to the cuvette to improve the numeric aperture. 

=t In addition, each optical leg can image objects at multiple focal planes to improve 

ttl focus on cells which may be defocused at a different focal plane. 

m 

15 Although each of the previous four embodiments for spectral decomposition 

!L were described in the context of imaging objects in flow, those skilled in the art will 

fij appreciate that the same spectral decomposition systems can be applied to objects 

y_ fixed to slides, microtiter plates, or other solid substrates. FIGURE 20 illustrates an 

embodiment in which motion of a substrate 73 is generally parallel or aligned with an 

20 axis of spectral decomposition provided by dichroic beam splitter 252. An optional 
epi illuminator 60a, which may comprise a laser or other type of illumination source, 
can be used to illuminate objects carried on substrate 73, while there is relative 
movement between the substrate and the imaging system in the direction of the 
double-headed arrow. Optionally, another illuminator 60b is provided to provide 

25 bright field illumination of the objects on the substrate with light reflected from a 
reflective surface 77. Light from the objects on substrate 73 passes through a lens 71, 
is reflected from a reflective surface 69, passes through a dichroic (or partially 
reflective) mirror 67 and is focussed on a slit 55 by a lens 57. Collection lens 32 
collimates the light from the slit and directs the light onto dichroic beam splitter 252, 

30 which spectrally disperses the light passing through lens 40 and onto different regions 
of detector 44, such as is shown in FIGURE 21. 
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FIGURE 5 also illustrates the application of the second spectral 
decomposition embodiment employed in an optical system to collect imagery from a 
solid substrate 73', which may be transparent, translucent, or opaque. In this 
embodiment, a FOV75 is either illuminated, for example, with light from epi 
illuminator 60. If used, light from the illuminator is directed by dichroic (or partially 
reflective mirror) 67 and by reflective surface 69 through a focussing lens 71 toward 
substrate 73'. Light from the substrate following this same path, is transmitted 
through the dichroic (or partially reflective) mirror and through lens 57, which 
focusses the light on slit 55. Light passing through the slit is collimated by collection 
lens 32 and directed to dichroic beam splitter 252, which spectral disperses the light 
onto different regions of detector 44. Those skilled in the art will also appreciate that 
where the fourth embodiment of the spectral decomposition system is employed, the 
FOV may be increased substantially in the axis perpendicular to movement to further 



ru 

ffl increase throughput. 



First Embodiment for Pixilated Detection 

The first pixilated detection embodiment employs frame-based charge 
coupled device (CCD) image collection, in which a CCD detector views cells in flow 
in a freeze frame fashion. This method requires the integration time to be very short 
to prevent blurring. A short integration time is achieved either with a strobed light 
source, or a continuous light source combined with a shuttered or gated detector. In 
either case, the short integration time reduces the signal-to-noise ratio and the 
ultimate sensitivity of the approach with fluorescence signals. Further, frame-based 
cameras require time to transfer data out of the camera, during which no images are 
acquired, and cells of interest can escape detection. However, these types of detectors 
are readily available, inexpensive, and do not require an accurate knowledge of the 
velocity of the cells in flow. 
Second Embodiment for Pixilated Detection 

A second embodiment of flow imaging for pixilated detection also employs 
frame-based CCD image collection, but does not rely on strobed illumination or 
shuttered detection to freeze image motion. Instead, a rotating or oscillating mirror is 
used to compensate for object motion to produce a still image on the detector. This 
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embodiment may employ continuous illumination, thereby achieving higher levels of 
sensitivity than strobed systems when analyzing fluorescence. However, this 
embodiment requires both an accurate measurement of object velocity and a very 
stable fluid pumping system, since the inertia of the mirror prevents compensation for 
5 rapid changes in object velocity. 

Third Embodiment for Pixilated Detection 

A third embodiment for pixilated detection uses TDI CCD image collection. 
In TDI detection, the electronic signal produced within the detector by an incident 
image is moved down the detector in synchrony with the motion of the image. In this 
10 manner, signal integration times can be increased over conventional frame imaging 
modes by a factor exceeding 1000 fold. FIGURES 3, 13, and 21 illustrate such a 
detector and shows the spectral zones in which the detector is divided. 
Object Illumination 

As shown in FIGURES 6 and 7, several different illumination systems may 

15 be employed to illuminate the cells in flow. A standard approach involves 
illuminating the cells in flow with a laser path oriented orthogonal to the spectral 
decomposition and imaging system. Alternative modes of illumination, such as 
those shown and FIGURES 6 and 7 and disclosed in above-referenced U.S. Patent 
No. 6,249,341, allow for the generation of bright field, dark field, phase contrast, 

20 fluorescence and epi-fluorescence imagery. The above-referenced commonly 
assigned U.S. Patent Application Serial No. 09/689,172, entitled "Multi-Pass Cavity 
for Illumination and Excitation of Moving Objects," filed on October 11, 2000, 
discloses a method for illumination in which the number of photons incident on the 
cells may increased by a factor of 10 or more. 

25 The design of the illumination system also allows the use of pulsed lasers or 

other strobed sources for high sensitivity fluorescence measurement without any need 
to strobe in synchrony with object flow. Solid state pulsed lasers can be orders of 
magnitude more efficient than gas lasers of similar average power and their high peak 
energy allows for efficient conversion of visible output to ultraviolet. The high aspect 

30 ratio also allows for highly efficient coupling of linear array diode illumination into 
the cuvette. 
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Cell Velocity Measurement 

For the second and third pixilated detection embodiments wherein an accurate 
knowledge of the cell velocity is required, a frequency domain velocity measurement 
(FDVM) technique as disclosed in U.S. Provisional Patent Application 
5 No. 60/228,076, filed on August 25, 2000 and entitled "Frequency Domain Object 
Velocity Measurement," can be employed. In FDVM, a large FOV is imaged onto a 
ruling of opaque and transparent bars. Motion of the objects within the FOV causes 
modulation of their intensity as they pass across the ruling. The modulation 
frequency is proportional to the velocity of the objects and can be determined using 
1 0 Fast Fourier Transform analysis. 
M= Velocity can also be determined using two detectors in a conventional 

q time-of-flight measurement scheme, though with very restricted throughput. As 

; ] described in U.S. Provisional Patent Application Serial No. 60/228,076, 

ffi time-of-flight measurements become more complex when throughput increases and 

?i 15 the times of flight of multiple objects are measured simultaneously. Such systems 
5 can fail when correlation is lost between the entry and exit times of the objects in 

ry view. The time-of-flight system preferably used relies on an improved scheme 

wherein the waveforms produced by the entry and exit detectors are cross-correlated 
O to detect phase changes that are indicative of changes in velocity. When the present 

20 invention is applied to objects on a solid substrate and when imaging in TDI mode, an 
encoder, laser interferometer, or other means may be used to determine the object 
velocity in order to synchronize the TDI detector. 

Although the present invention has been described in connection with the 
preferred form of practicing it, those of ordinary skill in the art will understand that 
25 many modifications can be made thereto within the scope of the claims that follow. 
Accordingly, it is not intended that the scope of the invention in any way be limited 
by the above description, but instead be determined entirely by reference to the claims 
that follow. 
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